
United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 
Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. | 


FILING DATE | 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 


10/621,872 


07/16/2003 


Ming-Hsuan Yang 


23085-07128 


1743 



758 7590 

FENWICK & WEST LLP 
SILICON VALLEY CENTER 
80 1 CALIFORNIA STREET 
MOUNTAIN VIEW, CA 94041 



03/22/2007 



EXAMINER 



YUAN, KATHLEEN S 



ART UNIT 



PAPER NUMBER 



2624 



SHORTENED STATUTORY PERIOD OF RESPONSE 



MAIL DATE 



DELIVERY MODE 



3 MONTHS 



03/22/2007 



PAPER 



Please find below and/or attached an Office communication concerning this application or proceeding. 



If NO period for reply is specified above, the maximum statutory period will apply and will expire 6 MONTHS 
from the mailing date of this communication. 



PTOL-90A (Rev. 10/06) 



Office Action Summary 



Application No. 

10/621,872 



Examiner 
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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 

for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS. 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 



Status 



1)13 Responsive to communication(s) filed on 15 August 2005 . 
2a)D This action is FINAL 2b)IEl This action is non-final. 

3)n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 
closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

* 

Disposition of Claims 



4) S Claim(s) 1-43 is/are pending in the application. 

* 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) E Claim(s) 1.6-10,15-21. 26-30 and 35-43 is/are rejected. 

7) 13 Claim(s^ 2-5. 1 1-14.22-25 and 31-34 is/are obiected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10) 13 The drawing(s) filed on 16 July 2006 is/are: a)n accepted or b)[3 objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d), 

1 1) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) 0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)n All b)n Some * c)n None of: 

1. n Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. 



3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 



Drawings 

1. Figure la and lb should be designated by a legend such as -Prior Art-- because 
only that which is old is illustrated. See MPEP § 608.02(g). These drawings were 
previously known and shown, such as in the article, "Nonlinear Dimensionality 
Reduction by Locally Linear Embedding" by Sam T. Roweis and Lawrence K. Saul. 
Corrected drawings in compliance with 37 CFR 1.121(d) are required in reply to the 
Office action to avoid abandonment of the application. The replacement sheet(s) should 
be labeled "Replacement Sheet" in the page header (as per 37 CFR 1.84(c)) so as not 
to obstruct any portion of the drawing figures. If the changes are not accepted by the 
examiner, the applicant will be notified and informed of any required corrective action in 
the next Office action. The objection to the drawings will not be held in abeyance. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C, 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
Invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claims 1, 6-9, 21, 26-29, 40 and 42 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over "Nonlinear Dimensionality Reduction by Locally Linear Embedding". 
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(Roweis et al) in view of "Evolutionary Pursuit and Its Application to Face Recognition" 
(Liu et al). 

Regarding claim 21, Roweis et al discloses a system for representing a set of 
images for pattern classification, tine system comprising: neighboring graph generation 
module, the module that carries out the steps of fig. 2, (1), for receiving data points 
corresponding to the set of images in an input space, the data points being all the points 
in the input space as seen in fig. 2, (1), and for generating a neighboring graph 
indicating whether the data points are neighbors, the neighboring graph being the black 
points that are selected in fig. 2, (1); a geodesic distance estimation module, the module 
that would carry out the steps of fig. 2, (2), for estimating geodesic distances between 

« 

the data points based upon the neighboring graph, in which the distances are measured 
to a selected point Xi, so that a weight can be calculated, Wik, to help reconstruct the 
point with the neighbors. Furthermore, Roweis et al discloses that the each of the data 
points are represented by an associated feature vector corresponding to the geodesic 
distances to other data points, the associated vector being the vector from the origin to 
each of the reduced dimensionality points in fig. 2, (3), and which correspond to the 

i 

geodesic distance because the reduced dimensionality data points are determined by 
the weights which in turn is determined by distances. 

Roweis et al does not disclose expressly that a Fisher Linear Discriminant 
module represents each of the data points by the associated feature vector and for 
applying Fisher Linear Discriminant to the feature vectors associated with the data 
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points to obtain an optinrial direction for projecting the feature vectors for pattern 
classification. 

Liu et al discloses that a Fisher Linear Discriminant is used to represent each of 
the data points by an associated feature vector, the vector being the vector from the 
origin to the data point, each of the data points represented by classes u)i,...u)l, in 
which many number of images are classified, represented by Ni,...Nl, each of the 
images being the each of the data points (pg. 572, paragraph 3). Furthermore, The 
Fisher Linear Discriminant is applied to the feature vectors associated with the data 
points to obtain an optimal direction for projecting the feature vectors for pattern 
classification by deriving the projection matrix that will maximize (pg. 572, pp. 4) 

Roweis et al and Liu et al are combinable because they are from the same field 
of endeavor, i.e. pattern classification in feature spaces and reducing information/ 

* 

dimensionality. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to use a Fisher Linear Discriminant to find the projection direction. 

The suggestion/motivation for doing so would have been to allow for the most 
accurate way to represent classes for recognition since the FLD distinguishes effectively 
between the between and within scatters. 

Therefore, it would have been obvious to combine the dimensionality reduction 
system of Roweis et al with the Fisher Linear Discriminant of Liu et al to obtain the 
invention as specified in claim 21 . 



% 
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4. Claims 1 , 40 and 42 are rejected for the same reasons as claim 21 . Thus, the 
arguments analogous to that presented above for claim 21 are equally applicable to 
claims 1 , 40 and 42. Claim 21 distinguishes from claims 1 , 40 and 42 only in that claim 
21 is a system claim in the preamble and claims 1, 40 and 42 are method, computer 
program product stored on a computer readable medium, and a broader systems claim, 
respectively. A system carries out a method, and furthermore, the preamble to the 

T 

claim is not given any patentable weight because it doesn't breath life or vitality into the 
claim; therefore, prior art applies. 

5. Regarding claim 26, Roweis et al discloses projecting the feature vectors to a 
lower dimensional space lower in dimension than the input space, since in fig. 2, (2) the 
vectors are in 3D and in fig. 2 (3), the space is in 2D, thus lower in dimension. Liu et al 
discloses the Fisher Linear Discriminant module applies Fisher Linear Discriminant to 
the feature vectors that were projecting the feature vectors to a lower dimensional 

t 

space lower in dimension than the input space by Roweis et al so as to substantially 
maximize a variance between clusters of feature vectors while substantially minimizing 
the variance within each cluster of the feature vectors, since Roweis et al maximizes the 
projection matrix which is the variance between clusters divided the variance within 
clusters (pg. 572. pp. 3 and 4), thus inherently maximizing the between clusters and 
minimizing the variance within each cluster. 

6. Regarding claim 27, Liu et al discloses the variance between the clusters of the 
feature vectors is represented by a between-class scatter matrix, Zw, and the variance 



4 
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within each cluster of the feature vectors is represented by a within-class scatter matrix 
lb, (pg. 572, paragraph 3 and eq. 4 and 5). 

7. Regarding claim 28, Liu et al and Rowels et al disclose that the feature vectors 
are projected to the lower dimensional space so as to substantially maximize a ratio of 
the between-class scatter matrix to the within-class scatter matrix, as explained above 
in the rejection for claim 26 and on pg. 572, pp. 4 of Liu et al. 

« 

8. Regarding claim 29, Liu et al discloses that FLD is applied to face images for 
face recognition (pg. 570, title). 

« 

9. Claims 6, 7, 8 and 9 are rejected for the same reasons as claims 26, 27, 28 and 
29, respectively. Thus, the arguments analogous to that presented above for claims 6, 
7, 8 and 9 are equally applicable to claims 26, 27, 28 and 29. Claims 6-9 distinguish 
from claims 27-29 only in that they have different dependencies, all of which have been 
previously rejected. Therefore, prior art applies. 

10. Claims 10, 14-20, 30, 34-39, 41 and 43 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Roweis et al in view of Liu et al, as applied to claim 21 above, 
and further in view of "A Mathematical Programming Approach to Kernel Fisher 
Algorithm" (Mika et al). 

Regarding claim 30, Roweis et al (as modified by Liu et al) discloses all of the 
claimed elements as set forth above and incorporated herein by reference. 

Claim 30 is rejected for the same reasons as claim 21 . Thus, the arguments 
analogous to that presented above for claim 21 are equally applicable to claim 30. 
Claim 21 distinguishes from claim 30 only in that claim 30 uses Kernel Fisher 
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Discriminant instead of simply the Fisher Discriminant. Mika et al teaches further this 
feature, i.e. the use of Kernel Fisher Discriminant (title). 

Roweis et al (as modified by Liu et al) and Mika et al are combinable because 
they are from the same field of endeavor, i.e. Fisher Discriminant Analysis. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to use a Kernel Fisher Discriminant. 

The suggestion/motivation for doing so would have been to provide a more 
flexible system by allowing the system to operate in a kernel feature space, thereby 
yielding a nonlinear discriminant. 

Therefore, it would have been obvious to combine the system of Roweis et al (as 
modified by Liu et al) with the Kernel Fisher Discriminant of Mika et al to obtain the 
invention as specified in claim 30. 

1 1 . Claims 10, 41 and 43 are rejected for the same reasons as claim 30. Thus, the 
arguments analogous to that presented above for claim 30 are equally applicable to 
claims 10, 41 and 43. Claim 30 distinguishes from claims 10, 41 and 43 only in that 
claim 30 is a system claim in the preamble and claims 10, 41 and 43 are method, 
computer program product stored on a computer readable medium, and a broader 
systems claim, respectively. A system carries out a method, and furthermore, the 
preamble to the claim is not given any patentable weight because it doesn't breath life 
or vitality into the claim; therefore, prior art applies. 

12. Regarding claim 35. Roweis discloses that Fisher Linear Discriminant analysis 
maximizes the projection matrix M^, which is the variance between clusters divided the 
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variance within clusters (pg. 572, pp. 3 and 4), thus inherently maximizing the between 
clusters and minimizing the variance within each cluster. Mika et al discloses the Kernel 
Fisher Linear Discriminant module applies Kernel Fisher Linear Discriminant to the 
feature vectors by: projecting the feature vectors to a high dimensional feature space 
using a projection function, the projection function being k(Xi,Xj) (pg. 2, paragraph 3), a 
Mercer Kernel function (pg. 1, paragraph 2); generating Kernel "Fisherfaces" of the 
feature vectors projected to the high dimensional feature space, the. feature vectors 
being that vector made by a test point; projecting the feature vectors to a lower 
dimensional space lower in dimension than the input space and the high dimensional 
feature space based on the Kernel "Fisherfaces" by projection of the test point onto the 
discriminant. Mika does not call the Kernel "Fisherfaces" distinctly fisherfaces, however, 
Liu et al discloses that FLD is applied to face images for face recognition (pg. 570, title), 
thus indicating the use of faces. 

1 3, Claims 36-37 are rejected for the same reasons as claims 7-8. Thus, the 
arguments analogous to that presented above for claims 7-8 are equally applicable to 
claims 36-37. Claims 36-37 distinguishes from claims 7-8 only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 

14. Regarding claim 39, Mika et al discloses that the projection function O (x) 
satisfies the following relation :k(x, y) = cD(x) ^(y) where k(x. y) is a kernel function, or 
k(Xi,Xj) = 0(Xi) •O(Xj), where x= Xj and y = Xj (pg. 2, paragraph 3). 
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15. Claims 15-17, 19 are rejected for the same reasons as claims 35-37, 39, 
respectively. Thus, the arguments analogous to that presented above for claims 35-37, 
39 are equally applicable to claims 15-17, 19. Claims 15-17, 19 distinguish from claims 
35-37, 39 only in that they have different dependencies, all of which have been 
previously rejected. Therefore, prior art applies. 

* 

16. Regarding claim 18, Mika et al discloses that the identity matrix is added to the 
kernel matrix (pg. 2, paragraph 3), thus adding a fraction of the identity matrix to the 

* 

within-class scatter matrix (equation 4). 

17. Regarding claim 38, Liu et al discloses that FLD is applied to face images for 
face recognition (pg. 570, title). 

18. Claim 20 is rejected for the same reasons as claim 38. Thus, the arguments 
analogous to that presented above for claim 38 are equally applicable to claim 20. 
Claim 20 distinguishes from claim 38 only in that they have different dependencies, all 
of which have been previously rejected. Therefore, prior art applies. 

< 

19. 

Allowable Subject Matter 

20. Claims 2-5, 1 1-14, 22-25 and 31-34 are objected to as being dependent upon a 
rejected base claim, but would be allowable if rewritten in independent form including all 
of the limitations of the base claim and any intervening claims. 

21 . Regarding claims 5, 14, 25 and 34, contains allowable subject of finding the 
geodesic distance between the data points by finding the distance with short hops 



t 
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according to the Floyd-Warshall algorithm. Roweis simply finds neighbors by directly 
finding the distance instead. 

22. Claims 2-4, 11-13, 22-24 and 31-33 contain allowable subject matter. Although 
LLE does all the steps excluding assigning an infinite value for the neighboring graph 
responsive to determining that the data points are not neighbors. 

^ T 

Conclusion 

23. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. "Think Globally, Fit Locally, Unsupervised Learning of Nonlinear 
Manifolds" (Saul et al). 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kathleen S. Yuan whose telephone number is (571)272- 
2902. The examiner can normally be reached on Monday to Thursdays, 9 AM to 5 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph Mancuso can be reached on (571)272-7695. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

■ 

KY 

3/6/2007 



JO;^p^;l^^JCuso 

fWTENT EXAJWINER 



